1 "Systiems and Methods for Generating Visual 

2 Representations of Graphical Data and Digital 

3 Docxament Processing" 

4 

5 Field of the Invention 

6 

7 The invention relates to data processing 

8 methods and systems. More particularly, the 

9 invention relates to methods and systems for 

10 processing "graphical data" and "digital documents" 

11 (as defined herein) and to devices incorporating 

12 such methods and systems. In general terms, the 
Q 13 invention is concerned with generating output 

^ 14 representations of source data and documents; e.g. 

W 15 as a visual display or as hardcopy. 

m 

£ 16 

17 Background to the Invention 

18 

O 

^ 19 As used herein, the terms "graphical data", 

20 "graphical object" and "digital document" are used 

f=H 21 to describe a digxtal representation of any type of 

22 data processed by a data processing system which is 

23 intended, ultimately, to be output in some form, in 

24 whole or in part, to a human user, typically by 

25 being displayed or reproduced visually (e.g. by 

26 means of a visual display unit or printer), or by 

27 text-to-speech conversion, etc. Such data, objects 

28 and documents may include any features capable of 

29 representation, including but not limited to the 

30 following: text; graphical images; animated 

31 graphical images; full motion video images; 

32 interactive icons, buttons, menus or hyperlinks- A 



digital document may also include non-visual 
elements such as audio (sound) elements. A digital 
document generally includes or consists of graphical 
data and/or at least one graphical object. 

Data processing systems, such as personal 
computer systems, are typically required to process 
"digital documents", which may originate from any 
one of a number of local or remote sources and which 
may exist in any one of a wide variety of data 
formats ("file formats"). In order to generate an 
output version of the document, whether as a visual 
display or printed copy, for example, it is 
necessary for the computer system to interpret the 
original data file and to generate an output 
compatible with the relevant output device (e.g. 
monitor, or other visual display device, or 
printer) . In general, this process will involve an 
application program adapted to interpret the data 
file, the operating system of the computer, a 
software "driver" specific to the desired output 
device and, in some cases (particularly for monitors 
or other visual display units) , additional hardware 
in the form of an expansion card. 

This conventional approach to the processing of 
digital documents in order to generate an output is 
inefficient in terms of hardware resources, software, 
overheads and processing time, and is completely 
unsuitable for low power, portable data processing 
systems, including wireless telecommunication 
systems, or for low cost data processing systems 



such as network terminals, etc. Other problems are 
encountered in conventional digital document 
processing systems, including the need to configure 
multiple system components (including both hardware 
and software components) to interact in the desired 
manner, and inconsistencies in the processing of 
identical source material by different systems (e.g. 
differences in formatting, colour reproduction, 
etc) . In addition, the conventional approach to 
digital document processing is unable to exploit the 
commonality and/or re-usability of file format 
components . 

Summary of the Invent:ion 

It is an object of the present invention to 
provide methods and systems for processing graphical 
data, graphical objects and digital documents, and 
devices incorporating such methods and systems, 
which obviate or mitigate the aforesaid 
disadvantages of conventional methods and systems. 

The invention, in its various aspects, is 
defined in the Claims appended hereto. Further 
aspects and features of the invention will be 
apparent from the following description. 

In a first aspect, the invention relates to a 
method of redrawing a visual display of graphical 
data whereby a current display is replaced by an 
updated display, comprising, in response to a redraw 
request, immediately replacing the current display 



with a first approximate representation of the 
updated display, generating a final updated display, 
and replacing the approximate representation with 
the final updated display. 

In a second aspect, the invention relates to a 
method of generating variable visual representations 
of graphical data, comprising dividing said 
graphical data into a plurality of bitmap tiles of 
fixed, predetermined size, storing said tiles in an 
indexed array and assembling a required visual 
representation of said graphical data from a 
selected set of said tiles. 

The methods of said second aspect may be 
employed in methods of the first aspect. 

A third aspect of- the invention relates to a 
method of processing a digital document, said 
document comprising a plurality of graphical objects 
arranged on at least one page, comprising dividing 
said document into a plurality of zones and, for 
each zone, generating a list of objects contained 
within and overlapping said zone. 

The methods of the second aspect may be 
employed in the methods of the third aspect. 

In accordance with a fourth aspect of the 
invention, there is provided a digital document 
processing system adapted to implement the methods 
of any of the first to third aspects. 



A preferred system in accordance with the 
fourth aspect of the invention comprises: 

an input mechanism for receiving an input 
bytestream representing source data in one of a 
plurality of predetermined data formats; 

an interpreting mechanism for interpreting said 
bytestream; 

a converting mechanism for converting 
interpreted content from said bytestream into an 
internal representation data format; and 

a processing mechanism for processing said 
internal representation data so as to generate 
output representation data adapted to drive an 
output device. 

In a further aspect, the invention relates to a 
graphical user interface for a data processing 
system in which interactive visual displays employed 
by the user interface are generated by means of a 
digital document processing system in accordance 
with the fourth aspect of the invention and to data 
processing systems incorporating such a graphical 
user interface. 

In still further aspects, the invention relates 
to various types of device incorporating a digital 
document processing system in accordance with the 
fourth aspect of the invention, including hardware 
devices, data processing systems and peripheral 
devices . 



1 Embodiments of the invention will now be 

2 described, by way of example only, with reference to 

3 the accompanying drawings. 
4 

5 Brief Description of the Drawings 

6 

7 Fig. 1 is a block diagram illustrating an 

8 embodiment of a preferred digital document 

9 processing system which may be employed in 

10 implementing various aspects of the present 

11 invention; 
12 

g 13 Fig. 2A is a flow diagram illustrating a first 

^ 14 embodiment of a first aspect of the present 

yj 15 invention; 

iff 

i 16 

® 17 Fig. 2B is a flow diagram illustrating a second 

W 

^ 18 embodiment of a first aspect of the present 

^ 19 invention; 

U 20 

Q 21 Fig. 3 is a diagram illustrating a method of 

22 scaling a bitmap in a preferred embodiment of the 

23 first aspect of the invention; 
24 

25 Fig. 4A is a diagram illustrating a 

26 conventional method of using an off-screen buffer 

27 for panning a visual display of a digital document; 
28 

29 Fig. 4B is a diagram illustrating a method of 

30 using an off-screen buffer for panning a visual 

31 display of a digital document in accordance with a 

32 second aspect of the present invention; 



Fig. 5A is a diagram illustrating memory 
allocation and fragmentation associated with the 
conventional method of Fig. 4A; 

Fig. 5B is a diagram illustrating memory 
allocation and fragmentation associated with the 
method of Fig. 4B; 

Fig. 5C is a diagram illustrating a preferred 
method of implementing the method of Fig. 4B. 

Fig. 6 is a diagram illustrating the use of 
multiple parallel processor modules for implementing 
the method of Fig. 4B; and 

Figs. 7 and 8 are diagrams illustrating a 
method of processing a digital document in 
accordance with a third aspect of the invention. 

Detailed Descrip-bxon of t:he Preferred Einbociimeni:s 

Referring now to the drawings. Fig. 1 
illustrates a preferred digital document processing 
system 8 in which the methods of the various aspects 
of the present invention may be implemented. Before 
describing the methods of the invention in detail, 
the system 8 will first be described by way of 
background. It will be understood that the methods 
of the present invention may be implemented in 
processing systems other than the system 8 as 
described herein. 
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In general terms, the system 8 will process one 
or more source documents 10 comprising data files in 
known formats. The input to the system 8 is a 
bytestream comprising the content of the source 
document. An input module 11 identifies the file 
format of the source document on the basis of any 
one of a variety of criteria, such as an explicit 
file-type identification within the document, from 
the file name (particularly the file name 
extension) , or from known characteristics of the 
content of particular file types. The bytestream is 
input to a "document agent" 12, specific to the file 
format of the source document. The document agent 12 
is adapted to interpret the incoming bytestream and 
to convert it into a standard format employed by the 
system 8, resulting in an internal representation 14 
of the source data in a "native" format suitable for 
processing by the system 8. The system 8 will 
generally include a plurality of different document 
agents 12, each adapted to process one of a 
corresponding plurality of predetermined file 
formats . 

The system 8 may also be applied to input 
received from an input device such as a digital 
camera or scanner. In this case the input 
bytestream may originate directly from the input 
device, rather than from a "source document" as 
such- However, the input bytestream will still be 
in a predictable data format suitable for processing 
by the system and, for the purposes of the system. 



1 input received from such an input device may be 

2 regarded as a "source document". 
3 

A The document agent 12 employs a library 16 of 

5 standard objects to generate the internal 

6 representation 14, which describes the content of 

7 the source document in terms of a collection of 

8 generic objects whose types are as defined in the 

9 library 16, together with parameters defining the 

10 properties of specific instances of the various 

11 generic objects within the document. It will be 

12 understood that the internal representation may be 
p 13 saved/stored in a file format native to the system 

14 and that the range of possible source documents 10 

yj 15 input to the system 8 may include documents in the 

16 system's native file format. It is also possible 

ffi 17 for the internal representation 14 to be converted 

2 18 into any of a range of other file formats if 

O 19 required, using suitable conversion agents (not 

|lx 2 0 shown) . 

m 21 

U 

22 The generic objects employed in the internal 

23 representation 14 will typically include: text, 

24 bitmap graphics and vector graphics (which may or 

25 may not be animated and which may be two- or three- 

26 dimensional) , video, audio, and a variety of types 

27 of interactive object such as buttons and icons. 

28 The parameters defining specific instances of 

29 generic objects will generally include dimensional 

30 co-ordinates defining the physical shape, size and 

31 location of the object and any relevant temporal 

32 data for defining objects whose properties vary with 



time (allowing the system to deal with dynamic 
document structures and/or display functions) . For 
text objects, the parameters will normally also 
include a font and size to be applied to a character 
string. Object parameters may also define other 
properties, such as transparency. 

The format of the internal representation 14 
separates the "structure" (or "layout") of the 
documents, as described by the object types and 
their parameters, from the "content" of the various 
objects; e.g. the character string (content) of a 
text object is separated from the dimensional 
parameters of the object; the image data (content) 
of a graphic object is separated from its 
dimensional parameters. This allows document 
structures to be defined in a very compact manner 
and provides the option for content data to be 
stored remotely and to be fetched by the system only 
when needed. 

The internal representation 14 describes the 
document and its constituent objects in terms of 
"high-level" descriptions . 

The internal representation data 14 is input to 
a parsing and rendering module 18 which generates a 
context-specific representation 20 or "view" of the 
document represented by the internal representation 
14. The required view may be of the whole document 
or of part(s) (subset (s)) thereof. The 
parser/renderer 18 receives view control inputs 40 



1 which define the viewing context and any related 

2 temporal parameters of the specific document view 

3 which is to be generated. For example, the system 

4 may be required to generate a zoomed view of part of 

5 a document, and then to pan or scroll the zoomed 

6 view to display adjacent portions of the document. 

7 The view control inputs 40 are interpreted by the 

8 parser/renderer 18 in order to determine which parts 

9 of the internal representation are required for a 

10 particular view and how, when and for how long the 

11 view is to be displayed. 
12 

2 13 The context-specific representation/view 20 is 

g 14 expressed in terms of primitive shapes and 

yj 15 parameters. 

Ul 

^ 17 The parser/renderer 18 may also perform 

2 18 additional pre-processing functions on the relevant 

^ 19 parts of the internal representation 14 when 

H 20 generating the required view 20 of the source 

^ 21 document 10. The view representation 20 is input to 

22 a shape processor module 22 for final processing to 

23 generate a final output 24, in a format suitable for 

24 driving an output device 26 (or multiple output 

25 devices), such as a display device or printer. 
26 

27 The pre-processing functions of the 

28 parser/renderer 18 may include colour correction, 

29 resolution ad j ustment /enhancement and anti-aliasing. 

30 Resolution enhancement may comprise scaling 

31 functions which preserve the legibility of the 

32 content of objects when displayed or reproduced by 
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1 the target output device. Resolution adjustment may 

2 be context-sensitive; e.g. the display resolution of 

3 particular objects may be reduced while the 

4 displayed document view is being panned or scrolled 

5 and increased when the document view is static (as 

6 described further below in relation to the first 

7 aspect of the invention) . 
8 

9 There may be a feedback path 42 between the 

10 renderer/parser 18 and the internal representation 

11 14; e.g. for the purpose of triggering an update of 

12 the content of the internal representation 14, such 
p 13 as in the case where the document 10 represented by 
^ 14 the internal representation comprises a multi-frame 
yj 15 animation. 

16 

W 17 The output representation 20 from the 

W 

5 18 parser/renderer 18 expresses the document in terms 

^ 19 of "primitive" objects. For each document object, 

M= 20 the representation 20 preferably defines the object 

01 

21 at least in terms of a physical, rectangular 

^ 22 boundary box, the actual shape of the object bounded 

23 by the boundary box, the data content of the object, 

24 and its transparency. 
25 

26 The shape processor 22 interprets the 

27 representation 20 and converts it into an output 

28 frame format 24 appropriate to the target output 

29 device 26; e.g. a dot-map for a printer, vector 

30 instruction set for a plotter, or bitmap for a 

31 display device. An output control input 44 to the. 

32 shape processor 22 defines the necessary parameters 



for the shape processor 22 to generate output 24 
suitable for a particular output device 26. 

The shape processor 22 preferably processes the 
objects defined by the view representation 20 in 
terms of "shape" (i.e. the outline shape of the 
object) , "fill" (the data content of the object) and 
"alpha" (the transparency of the object), performs 
scaling and clipping appropriate to the required 
view and output device, and expresses the object in 
terms appropriate to the output device (typically in 
terms of pixels by scan conversion or the like, for 
most types of display device or printer) . 

The shape processor 22 preferably includes an 
edge buffer which defines the shape of an object in 
terms of scan-converted pixels, and preferably 
applies anti-aliasing to the outline shape. Anti- 
aliasing is preferably performed in a manner 
determined by the characteristics of the output 
device 26 (i.e. on the basis of the control input 
44), by applying a grey-scale ramp across the object 
boundary. This approach enables memory efficient 
shape-clipping and shape-intersection processes. 

A look-up table may be employed to define 
multiple tone response curves, allowing non-linear 
rendering control (gamma correction) . 

The individual objects processed by the shape 
processor 22 are combined in the composite output 
frame 24. The quality of the final output can also 
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1 be controlled by the user via the output control 

2 input 44. 
3 

4 The shape processor 22 has a multi-stage 

5 pipeline architecture which lends itself to parallel 

6 processing of multiple objects, or of multiple 

7 documents, or of multiple subsets of one or more 

8 document, by using multiple instances of the shape 

9 processor pipeline. The pipeline architecture is 

10 also easily modified to include additional 

11 processing functions (e.g. filter functions) if 

12 required. Outputs from multiple shape processors 22 
p 13 may generate multiple output frames 24 or may be 

^ 14 combined in a single output frame 24. 

y 15 

Ul 

^ 16 The system architecture is modular in nature. 

^ 17 This enables, for example, further document agents 

w 

g 18 to be added as and when required, to deal with 

y 19 additional source file formats. The modular 

M= 20 architecture also allows individual modules such as 

fn 

21 the library 16, parser/renderer 18 or shape 

M' 22 processor 22 to be modified or upgraded without 

23 requiring changes to other modules. 
24 

25 The system architecture as a whole also lends 

26 itself to parallelism in whole or in part for 

27 simultaneous processing of multiple input documents 

28 10a, 10b etc. or subsets of documents, in one or 

29 more file formats, via one or more document agents 

30 12, 12a. The integrated, modular nature of the 

31 system allows multiple instances of system modules 

32 to be spawned within a data processing system or 
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device as and when required, limited only by 
available processing and memory resources. 

The potential for flexible parallelism provided 
by the system as a whole and the shape processor 22 
in particular allows the display path for a given 
device to be optimised for available bandwidth and 
memory. Display updates and animations may be 
improved, being quicker and requiring less memory. 
The object /parameter document model employed is 
deterministic and consistent. The system is fully 
scalable and allows multiple instances of the system 
across multiple CPUs. 

The parser/renderer 18 and shape processor 22 
interact dynamically in. response to view control 
inputs 40, in a manner which optimises the use of 
available memory and bandwidth. This applies 
particularly to re-draw functions when driving a 
visual display, e.g. when the display is being 
scrolled or panned by a user. 

Firstly, the system may implement a scalable 
deferred re-draw model, in accordance with a first 
aspect of the invention, such that the display 
resolution of a document view, or of one or more 
objects within a view, varies dynamically according 
to the manner in which the display is to be 
modified. This might typically involve an object 
being displayed at reduced resolution whilst being 
moved on-screen and being displayed at full 
resolution when at rest. The system may employ 
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1 multiple levels of display quality for this purpose. 

2 Typically, this will involve pre-built, low 

3 resolution bitmap representations of document 

4 objects and/or dynamically built and scaled bitmaps, 

5 with or without interpolation. This approach 

6 provides a highly responsive display which makes 

7 best use of available memory/bandwidth. 
8 

9 Methods embodying this first aspect of the 

10 present invention are illustrated in Figs. 2A and 

11 2B. 
12 

p 13 When a redraw request is initiated within the 

^ 14 system, it is necessary for all or part of the 

LiJ 15 current frame to be re-rendered and displayed. The 

^ 16 process of re-rendering the frame may take a 

17 significant amount of time. 

r 18 

19 Referring to Fig. 2A, when a redraw request 100 

!^ 

H= 20 is initiated, the output frame is immediately 

01 

21 updated (102) using one or more reduced resolution 

^ 22 ("thumbnail") bitmap representations of the document 

23 or parts thereof which are scaled to approximate the 

24 required content of the redrawn display. In the 

25 system 8 of Fig. 1, the bitmap representation ( s ) 

26 employed for this purpose may be pre-built by the 

27 parser/renderer 18 and stored for use in response to 

28 redraw requests. This approximation of the redrawn 

29 display can be generated much more quickly than the 

30 full re-rendering of the display, providing a 

31 temporary display while re-rendering is completed. 

32 In the embodiment of Fig. 2A, the full re-rendering 
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1 of the display (104) is performed in parallel with 

2 the approximate redraw 102, and replaces the 

3 temporary display once it is complete (106). The 

4 . method may include one or more additional 

5 intermediate updates 108 of the approximate 

6 temporary display while the full re-rendering 104 is 

7 completed- These intermediate updates may 

8 progressively "beautify" the temporary display (i.e. 

9 provide successively better approximations of the 

10 final display); e.g. by using better guality scaled 

11 bitmaps and/or by superimposing vector outlines of 

12 objects on the bitmap(s). 

'"H 14 The method of Fig. 2A also allows the redraw 

yj 15 process to be interrupted by a new redraw request 

3 Fs 

^ 16 (110) . The full re-rendering process 104 can simply 

03 17 be halted and the system processes the new redraw 

yJ 

5 18 request as before. 

1=^ 20 Fig. 2B illustrates an alternative embodiment 

m 

5=- 21 in which a redraw request 112 is followed by an 

H 22 approximate thumbnail-based redraw 114 as before, 

23 and the full frame redraw 116 follows in series 

24 after the approximate redraw (instead of in parallel 

25 as in Fig. 2A) .to generate the final full resolution 

26 display 118. This process may also be interrupted 

27 at any stage by a new redraw request. 
28 

29 The methods of Figs. 2A and 2B may be applied 

30 to all types of redraw requests, including screen 

31 re-builds, scrolling, panning and scaling (zooming). 
32 
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1 Fig. 3 illustrates a preferred method of 

2 zooming/scaling a thumbnail bitmap. A basic bitmap 

3 120 is created and stored by the system at some 

4 previous stage of document processing as previously 

5 described. Assuming that the bitmap is required to 

6 be scaled by some arbitrary factor (e.g. by a factor 

7 4.4), the basic thumbnail 120 is scaled in two 

8 stages: first, the thumbnail is scaled by a 

9 fractional amount (122) corresponding to the final 

10 scaling factor divided by the whole number part 

11 thereof (4.4 divided by 4 equals 1.1 in this 

12 example), and then by an integer amount (124) 

13 corresponding to the whole number part of the final 
^ 14 scaling factor (i.e. x4 in this example) . This is 
hj 15 faster than a single stage zoom of 4.4, at the 

^ 16 expense of a small increase in memory requirement. 



ra 17 

5.3 

3^ 18 The scaling operations described above may be 

O 19 performed with or without interpolation. Fig. 3 

20 shows the final zoomed bitmap 124 interpolated to 

2 21 provide a resolution of 16 x 16 as compared with the 

y= 22 original 8x8 bitmap 120. Interpolation may be 

23 performed using any of a variety of well known 

24 interpolation methods. 
25 

26 The ability to process transparent objects is a 

27 significant feature of the system of Fig. 1. 

28 However, this necessitates the use of off-screen 

29 buffering in the shape processor 22 in order to 

30 assemble a final output frame. Typically, as shown 

31 in Fig. 4A, a conventional off-screen buffer 130 

32 will cover an area larger than the immediate display 
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area, allowing a limited degree of panning/scrolling 
within the buffer area, but the entire buffer has to 
be re-centred and re-built when the required display 
moves outwith these limits. This requires a block- 
copy operation within the buffer and redrawing of 
the remaining "dirty rectangle" (132) before block- 
copying the updated buffer contents to the screen 
134. 

In accordance with a second aspect of the 
present invention, as illustrated in Fig. 4B, the 
efficiency of such buffering processes is improved 
by defining the buffer content as an array of tiles 
136, indexed in an ordered list. Each tile 
comprises a bitmap of fixed size (e.g. 32 x 32 or 64 
X 64) and may be regarded as a "mini-buffer". When 
the required display view moves outwith the buffer 
area, it is then only necessary to discard those 
tiles which are no longer required, build new tiles 
to cover the new area of the display and update the 
tile list (138). This is faster and more efficient 
than conventional buffering processes, since no 
block-copying is required within the buffer and no 
physical memory is required to be moved or copied. 

The tiling scheme described may be used 
globally to provide a tilepool for all document and 
screen redraw operations. The tiles are used to 
cache the document (s) off-screen and allow rapid, 
efficient panning and re-centering of views. 
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1 The use of a tilepool as described also allows 

2 for more efficient usage of memory and processor 

3 resources. Fig. 5A shows how conventional off- 

4 screen buffering methods, involving data blocks 

5 which have arbitrary, unpredictable sizes, result in 

6 the fragmentation of memory due to unpredictable 

7 contiguous block allocation requirements. Blocks of 

8 memory required by buffering operations are mis- 

9 matched with processor memory management unit (MMU) 

10 blocks, so that re-allocation of memory becomes 

11 inefficient, requiring large numbers of physical 

12 memory copy operations, and cache consistency is 

13 impaired. By using tiles of fixed, predetermined 

14 size, memory requirements become much more 

15 predictable, so that memory and processor resources 

16 may be used and managed much more efficiently, 

17 fragmentation may be unlimited without affecting 

18 usability and the need for memory copy operations 

19 may be substantially eliminated for many types of 

20 buffering operations. Ideally, the tile size is 

21 selected to correspond with the processor MMU block 

22 size. 
23 

24 Fig. 5C illustrates a preferred scheme for 

25 managing tiles within the tilepool. Tile number 

26 zero is always reserved for building each new tile. 

27 Once a new tile has been built, it is re-numbered 

28 using the next available free number {i.e. where the 
29' tilepool can accommodate a maximum of n tiles the 

30 number of tile addresses allocated is restricted to 

31 n-1). In the event of a tilepool renumbering 

32 failure, when the tilepool is full and there are no 



more free tiles, the new tile 0 is written directly 
to screen and a background process (thread) is 
initiated for garbage collection (e.g. 
identification and removal of "aged" tiles) and/or 
allocation of extra tile addresses. This provides 
an adaptive mechanism for dealing with resource- 
allocation failures . 

The tiling scheme described lends itself to 
parallel processing, as illustrated in Fig. 6. 
Processing of a set of tiles can be divided between 
multiple parallel processes (e.g. between multiple 
instances of the shape processor 22 of Fig. 1). For 
example, a set of tiles 1-20 can be divided based on 
the screen positions of the tiles so that the 
processing of tiles 1-10 is handled by one processor 
WASP-A and the processing of tiles 11-20 is handled 
by a second processor WASP-B. Accordingly, if a 
redraw instruction requires tiles 1-3, 7-9 and 12-14 
to be redrawn, tiles 2-4 and 7-9 are handled by 
WASP-A and tiles 12-14 by WASP-B. Alternatively, 
the set of tiles can be divided based on the 
location of the tiles in a tile memory map, dividing 
the tile memory into memory A for processing by 
WASP-A and memory B for processing by WASP-B. 

The tiling scheme described facilitates the use 
of multiple buffering and off-screen caching. It 
also facilitates interruptable re-draw functions 
(e.g. so that a current re-draw may be interrupted 
and a new re-draw initiated in response to user 
input), efficient colour/display conversion and 
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1 dithering, fast 90 degree (portrait /landscape) 

2 rotation of whole display in software, and reduces 

3 the redraw memory required for individual objects. 

4 Tiling also makes interpolated bitmap scaling faster 

5 and more efficient. It will also be appreciated 
5 that a system such as that of Fig. 1 may employ a 

7 common tilepool for all operating system/GUI and 

8 application display functions of a data processing 

9 system. 
10 

11 It will be understood that the tiling methods 

12 of the second aspect of the invention may 

Q 13 advantageously be combined with the redraw methods 

^ 14 of the first aspect of the invention. 

Si 

W 15 

y I 

^ 16 In accordance with a third aspect of the 

"7"" 

17 present invention, the processing of a document 

g 18 involves dividing each page of the document to be 

^ 19 viewed into zones (this would involve interaction of 

H> 20 the renderer /parser 18 and shape processor 22 in the 

^ 21 system 8 of Fig. 1), as illustrated in Fig. 7. Each 

22 zone A, B, C, D has associated with it a list of all 

23 objects 1-8 contained within or overlapping that 

24 zone. Re-draws can then be processed on the basis 

25 of the zones, so that the system need only process 

26 objects associated with the relevant zones affected 

27 by the re-draw. This approach facilitates parallel 

28 processing and improves efficiency and reduces 

29 redundancy. The use of zones also facilitates the 

30 use of the system to generate different outputs for 

31 different display devices (e.g. for generating a 
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1 composite/mosaic output for display by an array of 

2 separate display screens) . 
3 

4 As illustrated in Fig. 8, without the use of 

5 zoning, any screen update relating to the shaded 

6 area 142 would require each of the eight objects 1 

7 to 8 to be checked to see whether the bounding box 

8 of the object intersects the area 142 in order to 

9 determine whether that object needs to be plotted. 

10 With zoning, it is possible to determine firstly 

11 which zones intersect the area 142 (zone D only in 

12 this example) , secondly, which objects intersect the 

13 relevant zone(s) (object 2 only in this case), and 

14 then it is only necessary to check whether the 

yj 15 bounding boxes of those objects which intersect the 

Ul 

^ 16 relevant zone(s) also intersect the area 142. In 

03 17 many cases, this will greatly reduce the overhead 

yj 

18 involved in extracting and comparing objects with 

P 19 the area 142 of interest. 

^ 21 It will be appreciated that zoning of this type 

1=^ 22 may be of little or no benefit in some circumstances 

23 (e.g. in the extreme case where all objects on a 

24 page intersect all zones of the page) ; the 

25 relationship between the zone size and the typical 

26 object size may be significant in this respect. For 

27 the purposes of determining the nature of any zoning 

28 applied to a particular page, an algorithm may be 
2 9 employed to analyse the page content and to 

30 determine a zoning scheme (the number, size and 

31 shape of zones) which might usefully be employed for 

32 that page. However, for typical page content, which 



24 

1 will commonly include many small, locally clustered 

2 objects, an arbitrary division of the page into 

3 zones is likely to yield significant benefits. 
4 

5 The zoning and tiling schemes described above 

6 are independent in principle but may be combined 

7 advantageously; i.e. zones may correlate with one or 

8 more tiles. Again this facilitates parallelism and 

9 optimises use of system resources. 
10 

11 Referring again to Fig. 1, the system 

12 preferably employs a device-independent colour 

^ 13 model, suitably a luminance/chrominance model such 

=fl 14 as the CIE L*a*b* 1976 model. This reduces 

yj 15 redundancy in graphic objects, improves data 

16 compressibility and improves consistency of colour 

4- 

K 17 output between different output devices. Device- 

i : i " 

18 dependent colour correction can be applied on the 

P 19 basis of the device-dependent control input 44 to 

20 the shape processor 22. 

E 21 

ff ft. 

22 Fig. 1 shows the system having an input end at 

23 which the source bytestream is received and an 

24 output end where the final output frame 24 is output 

25 from the system. However, it will be understood 

26 that the system may include intermediate inputs and 

27 outputs at other intermediate stages, such as for 

28 fetching data content or for saving/converting data 

29 generated in the course of the process. 
30 

31 Digital document processing systems in 

32 accordance with the fourth aspect of the present 
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1 invention may be incorporated into a variety of 

2 types of data processing systems and devices, and 

3 into peripheral devices, in a number of different 

4 ways. 
5 

5 In a general purpose data processing system 

7 (the "host system"), the system of the present 

8 invention may be incorporated alongside the 

9 operating system and applications of the host system 

10 or may be incorporated fully or partially into the 

11 host operating system. 
12 

f=7 13 For example, the system of the present 

14 invention enables rapid display of a variety of 

m 

y 15 types of data files on portable data processing 

J 16 devices with LCD displays without requiring the use 

W 17 of browsers or application programs. This class of 

18 data processing devices requires small size, low 

19 power processors for portability. Typically, this 

20 requires the use of advanced RISC-type core 

21 processors designed into ASICs (application specific 
M? 22 integrated circuits) , in order that the electronics 

23 package is as small and highly integrated as 

24 possible- • This type of device also has limited 

25 random access memory and typically has no non- 
26 volatile data store (e.g. hard disk). Conventional 

27 operating system models, such as are employed in 

28 standard desktop computing systems (PCs) , require 

29 high powered central processors and large amounts of 

30 memory in order to process digital documents and 

31 generate useful output, and are entirely unsuited 

32 for this type of data processing device. In 



m 
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1 particular, conventional systems do not provide for 

2 the processing of multiple file formats in an 

3 integrated manner. By contrast, the present 

4 invention may utilise common processes and pipelines 

5 for all file formats, thereby providing a highly 
5 integrated document processing system which is 

7 extremely efficient in terms of power consumption 

8 and usage of system resources - 
9 

10 The system of the present invention may be 

11 integrated at the BIOS level of portable data 

12 processing devices to enable document processing and 

13 output with much lower overheads than conventional 

14 system models. Alternatively, the invention may be 
yj 15 implemented at the lowest system level just above 

Li " 

"pj 16 the transport protocol stack. For example, the 

K 17 system may be incorporated into a network device 

y 

. 18 (card) or system, to provide in-line processing of 

19 network traffic (e.g. working at the packet level in 

20 a TCP/IP system) , 
2 21 

Q 

H ' 22 In a particular device, the system of the 

23 invention is configured to operate with a 

24 predetermined set of data file formats and 

25 particular output devices; e.g. the visual display 

26 unit of the device and/or at least one type of 

27 printer. 
28 

29 Examples of portable data processing devices 

30 which may employ the present system include 

31 "palmtop" computers, portable digital assistants 

32 (PDAs, including tablet-type PDAs in which the 
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primary user interface comprises a graphical display 
with which the user interacts directly by means of a 
stylus device) , internet-enabled mobile telephones 
and other communications devices, etc. 



The system may also be incorporated into low 
cost data processing terminals such as enhanced 
telephones and "thin" network client terminals (e.g. 
network terminals with limited local processing and 
storage resources), and "set-top boxes" for use in 
interactive/internet-enabled cable TV systems. 



When integrated with the operating system of a 
data processing system, the system of the present 
invention may also form the basis of a novel 
graphical user interface (GUI) for the operating 
system (OS) . Documents processed and displayed by 
the system may include interactive features such as 
menus, buttons, icons etc. which provide the user 
interface to the underlying functions of the 
operating system. By extension, a complete OS/GUI 
may be expressed, processed and displayed in terms 
of system "documents". The OS/GUI could comprise a 
single document with multiple "chapters". 

The system of the present invention may also be 
incorporated into peripheral devices such as 
hardcopy devices (printers and plotters), display 
devices (such as digital projectors), networking 
devices, input devices (cameras, scanners etc.) and 
also multi-function peripherals (MFPs). 
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1 ^ When incorporated into a printer, the system 

2 may enable the printer to receive raw data files 

3 from the host data processing system and to 

4 reproduce the content of the original data file 

5 correctly, without the need for particular 

6 applications or drivers provided by the host system. 

7 This avoids the need to configure a computer system 

8 to drive a particular type of printer. The present 

9 system may directly generate a dot-mapped image of 

10 the source document suitable for output by the 

11 printer (this is true whether the system is 

12 incorporated into the printer itself or into the 

g 13 host system) . Similar considerations apply to other 

^ 14 hardcopy devices such as plotters - 



16 When incorporated into a .display device, such 



y 15 

16 

ra 17 as a projector, the system may again enable the 

w. 

18 device to display the content of the original data 

M 19 file correctly without the use of applications or 

i:^ 20 drivers on the host system, and without the need for 

^ 21 specific configuration of the host system and/or 

y= 22 display device. Peripheral devices of these types, 

23 when equipped with the present system, may receive 

24 and output data files from any source, via any type 

25 of data communications network, 
26 

27 From the foregoing, it will be understood that 

28 the system of the present invention may be "hard- 
2 9 wired; e.g. implemented in ROM and/or integrated 

30 into ASICs or other single-chip systems, or may be 

31 implemented as firmware (programmable ROM such as 

32 flashable ePROM) , or as software, being stored 
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1 locally or remotely and being fetched and executed 

2 as required by a particular device. 
3 

4 Improvements and modifications may be 

5 incorporated without departing from the scope of the 

6 present invention. 
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